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Abstract 

Using recent results on the behavior of multiple Wiener- Ito integrals based on Stein's 
method, we prove Hsu-Robbins and Spitzer's theorems for sequences of correlated random 
variables related to the increments of the fractional Brownian motion. 
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1 Introduction 

A famous result by Hsu and Robbins [7] says that if X%, X2, ■ ■ ■ is a sequence of independent 
identically distributed random variables with zero mean and finite variance and S n := X\ + 
. . . + X n , then 

y^PPffwl > en) < 00 

n>l 

for every e > 0. Later, Erdos ([3], [1]) showed that the converse implication also holds, namely 
if the above series is finite for every e > and X\ , X2 , . . . are independent and identically 
distributed, then EXi = and EXf < 00. Since then, many authors extended this result in 
several directions. 

Spitzer's showed in [13] that 



^ n 

n>l 



\S n \ > en) < 00 



for every e > if and only if EXi = and E|Xj| < 00. Also, Spitzer's theorem has been 
the object of various generalizations and variants. One of the problems related to the Hsu- 
Robbins' and Spitzer's theorems is to find the precise asymptotic as e — > of the quantities 
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En>i P (\ S n\ > £") and J2 n >i ^ P (\ S n\ > en). Heyde [5j showed that 

lim e 2 p (\Sn\ > en) = EX 2 (1) 



n>l 



whenever EX\ = and EX 2 < oo. In the case when X is attracted to a stable distribution 
of exponent a > 1, Spataru [12] proved that 

1 x-^ 1 . , , a 

hm 



£ Ip (|S n |> en) = ^-. (2) 
^— ' n a — 1 



e^O — log e 

to n>l 

The purpose of this paper is to prove Hsu-Robbins and Spitzer's theorems for sequences of 
correlated random variables, related to the increments of fractional Brownian motion, in the 
spirit of [5] or [12]. Recall that the fractional Brownian motion (-B/Ote[o,i] is a centered 
Gaussian process with covariance function R H (t, s) = E(B^ B^) = ^(t 2H + s 2H — \t — s| 2 ^)- 
It can be also defined as the unique self-similar Gaussian process with stationary increments. 
Concretely, in this paper we will study the behavior of the tail probabilities of the sequence 

n-1 

V n = Y J H q (ji H (Bm - ) (3) 

fc=0 

where B is a fractional Brownian motion with Hurst parameter H € (0,1) (in the sequel we 
will omit the superscript H for B) and H q is the Hermite polynomial of degree q > 1 given 

by H q (x) = (—l) q e~-^(e~~). The sequence V n behaves as follows (see e.g. [9], Theorem 
1; the result is also recalled in Section 3 of our paper): if < H < 1 — <^,a central limit 

theorem holds for the renormalized sequence Zn = — — t= while ifl — J^<iJ<l, the 

sequence = converges in L 2 (Q) to a Hermite random variable of order q 

(see Section 2 for the definition of the Hermite random variable and Section 3 for a rigorous 
statement concerning the convergence of V n ). Here c\q,n, °2,q,H are explicit positive constants 
depending on q and H. 

We note that the techniques generally used in the literature to prove the Hsu-Robbins 
and Spitzer's results are strongly related to the independence of the random variables X\, X2, . . 
In our case the variables are correlated. Indeed, for any k, I > 1 we have 
E (H q (Bk + i — Bj,)H q (Bi + i — Bi)) = j^jpu(k — I) where the correlation function is pn(k) = 

^ ((k + 1) 2H + (k — 1) 2H — 2k 2H ) which is not equal to zero unless H = ^ (which is the case 
of the standard Brownian motion). We use new techniques based on the estimates for the 
multiple Wiener- ltd integrals obtained in [2], [10] via Stein's method and Malliavin calculus. 
Concretely, we study in this paper the behavior as e — > of the quantities 



E l p ^ > en ) = E \ p ( z n ] > oriw*) 

n>l n>l 



(4) 
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and 

Y,P{V n >en) = Y J P (zP > <hin^) , (5) 

n>l n>l 

if < H < 1 - i and of 

£ ^ (K > fi n a -^) = £ IP (Z« > c^^ 1 -^) (6) 



n v / ' — ' n 

n>l n>l 

and 

£ P (V«> ^n^-^) =E P (4 2) > c^n 1 ^ 1 -*)) (7) 

n>l n>l 

if 1 — < H < 1. The basic idea in our proofs is that, if we replace ^n 1 "* and zffl by 
their limits (standard normal random variable or Hermite random variable) in the above 
expressions, the behavior as e — * can be obtained by standard calculations. Then we need 
to estimate the difference between the tail probabilities of Zn \ Zn^ and the tail probabilities 
of their limits. To this end, we will use the estimates obtained in [2], [10] via Malliavin 
calculus and we are able to prove that this difference converges to zero in all cases. We 
obtain that, as e — ► 0, the quantities (jl]) and ([6]) are of order of loge while the functions (|5|) 
and ([7|) are of order of e 2 and e^i^-H) respectively. 

The paper is organized as follows. Section 2 contains some preliminaries on the 
stochastic analysis on Wiener chaos. In Section 3 we prove the Spitzer's theorem for the 
variations of the fractional Brownian motion while Section 4 is devoted to the Hsu-Robbins 
theorem for this sequence. 

Throughout the paper we will denote by c a generic strictly positive constant which 
may vary from line to line (and even on the same line). 



2 Preliminaries 

Let (Wi)j g r 0) i] be a classical Wiener process on a standard Wiener space (il,^ 7 , P). If / € 
L 2 ([0, l] n ) with n > 1 integer, we introduce the multiple Wiener-Ito integral of / with respect 
to W. The basic reference is |11| . 

Let / € S m be an elementary function with m variables that can be written as 

/= ^2 Ci 1 ,...i m ^-Ai 1 x...xA im 

1\ i • ••• > 1rn 

where the coefficients satisfy Cj lr ..j m = if two indices ik and i\ are equal and the sets 
Ai £ B([0, 1]) are disjoint. For such a step function / we define 

I m (f)= £ c il) .. Am W(A il )...W(A im ) 
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where we put W(.A) = l^(s)(iW s if A € £>([0, 1]). It can be seen that the mapping I n 
constructed above from S m to L 2 (Q) is an isometry on S m , i.e. 

E [/„(/) I m {g)] =n!(/,5} I/ 2([ 0j i]n) if m = n (8) 

and 

E [I n (f)I m (g)} = if m ^ n. 

Since the set S n is dense in L 2 ([0, l] n ) for every n > 1 the mapping I n can be extended 
to an isometry from L 2 ([0, l] n ) to L 2 (f2) and the above properties hold true for this extension. 

We will need the following bound for the tail probabilities of multiple Wiener-Ito 
integrals (see [8], Theorem 4.1) 

P(\I n (f)\>u)<cexp(j^y} (9) 

for all u > 0, n > 1, with a = ||/||L 2 ([o,i] n )- 

The Hermite random variable of order q > 1 that appears as limit in Theorem [H 
point ii. is defined as (see [S]) 

Z = d(q,H)I q (L) (10) 
where the kernel L £ L 2 ([0,l] q ) is given by 

L(yi, ■■■,Vq)= [ diK H (u, yi)... diK H (u, y q )du. 

The constant d(q, H) is a positive normalizing constant that guarantees that EZ 2 = 1 and 
K is the standard kernel of the fractional Brownian motion (see [11] , Section 5) . We will 
not need the explicit expression of this kernel. Note that the case q = 1 corresponds to the 
fractional Brownian motion and the case q = 2 corresponds to the Rosenblatt process. 



3 Spitzer's theorem 

Let us start by recalling the following result on the convergence of the sequence V n @ (see 
[9j, Theorem 1). 

Theorem 1 Let q > 2 an integer and let (Bt)t>o a fractional Brownian motion with Hurst 
parameter H £ (0,1). Then, with some explicit positive constants c\ tq> H > C2 q,H depending 
only on q and H we have 

i. //0<iT<l-i then 

Vn Law 3 JV(0,1) (11) 



ci, q ,Hy/n 
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ii. Ifl-^<H<1 then 



V, 



C2,q,Hn 



l-q(l-H) 



(12) 



where Z is a Hermite random variable given by hlO\l. 



In the case H = 1 — ^ the limit is still Gaussian but the normalization is different. However 
we will not treat this case in the present work. 



We set 



Z (i) 



Vn 



Vn 



with the constants c\^n,C2,q,ji from Theorem [TJ 
Let us denote, for every e > 0, 



(13) 



/l( £ ) = E \ P > ™) = E \ P > C liH^ 



(14) 



n>l 



n>l 



and 



m*) = E ^ fa > - 2 - 29(1 ^ ) ) = E \ p fa w > ^ W"* 1 - 10 ) ( 15 ) 



n>l 



n>l 



Remark 1 It is natural to consider the tail probability of order [T5\) because 

the I? norm of the sequence V n is in this case of order n 1 ^ q ^ H \ 



We are interested to study the behavior of /i(e) (i = 1,2) as e — ► 0. For a given 
random variable X, we set ®x(z) = 1 - P{X < z) + P(X < -z). 

The first lemma gives the asymptotics of the functions fi(e) as e — > when are 
replaced by their limits. 



Lemma 1 Consider c > 0. 
i. Lei Z^ 1 ) 6e a standard normal random variable. Then as 



E -®zm( ce Vn) -> e -*o 2. 

-iff f»jr ^ — ' r) 



— log ce 4rf n 

n>l 



ii. Zei Z^ 2 ) 6e a Hermite random variable or order q given by [W\) . Then, for any integer 
q> 1 

ncr «r ✓ rj 



log ce ' n 

n>l 
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Proof: The case when follows the standard normal law is hidden in [12]. We will give 
the ideas of the proof. We can write (see [12] ) 



^ poo -y I /*oo 

V -$ zm {cE^n) = / -<f> zW (ce^dx - -$ z( i)(ce) - / P x {x)d 
n>i n Ji x 2 J 1 



x 



$ Z (i)(ce>/x) 



with P\{x) = [x] — x + \. Clearly as e — > 0, j^^^(i)(c^) — ► because $ z (i) is a bounded 
function and concerning the last term it is also trivial to observe that 



log ce 



Pi(x)d 



logce(~/ P ^ x ){^2^zw{ce^)dx + ce^x *^& zm (ey/x)\ dx\ 



since 3> Z (i> and are bounded. Therefore the asymptotics of the function /i(e) as e — > 

will be given by j$ Z (i) (c£y/x)dx. By making the change of variables ce^fx = y, we get 

l f°° l l Z" 00 l 

lim — / -<J) 7 (i)(cev/x)dx = lim — 2 / -§ 7 m{y)dy = lim 2<3? 7 m (ce) = 2. 

e^o-logce^ x zy n v ; £ ^o-logce 7 ce y 21 ny; e->o Zi n ; 

Let us consider now the case of the Hermite random variable. We will have as above 



lim — i— V i* zC2) ( C en 1 -«( 1 - H ); 
e^o - log ce ^ n z v 

n>l 



l-g(l--ff) 



1 / f°° 1 

lim — / -$ 7(2 ) (cex 



)<ix 



Pi(x)d 



-$ z(2 )(cex 
x 



By making the change of variables cex 1 q ^ H ' = y we will obtain 



lim 

e-^o — log ce 

1 

e^O — log ce 



-cl> 



z(2) [cex 



l-q{X-H) 



)dx 



r °° 1 1 1 

lim — — / -$ Z ( 2) (y)d|/ = lim r-r$ Z ( 2) ( ce ) = ~, j- , 

1 - q(l - H) J C£ y ^ol- g(l -H) 1 - 9(1 - #j 

where we used the fact that & Z (2)(y) < y~ 2 'E\Z^\ 2 and so lim^oo logy<3? Z (2) (y) = 0. 

It remains to show that _ J- ^ Pi(x)d [^$ Z (2) (cex l ~ q ^~ H ')\ converges to zero as 
e tends to (note that actually it follows from a result by pQ that a Hermite random variable 
has a density, but we don't need it explicitly, we only use the fact that $ Z (2) is differentiable 
almost everywhere). This is equal to 

1 f 00 

lim— j— -J P 1 (x)ce(l - q(l - H^x^-^^'^cex^^-^dx 



q(i-H) r°° 



loge 



(ce) i-9(i-h) 



Pi 



y \ l-q(l-H) 



ce 



& z m(y)y ^-^dy 



c- 



loge 



Pi 



1 \ 1-?(1-H) 

ce 



$ z(2) 
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which clearly goes to zero since P\ is bounded and <^' z(2) (y)dy = 1. ■ 

The next result estimates the limit of the difference between the functions fi(s) given 
by CEU), (fT5|) and the sequence in Lemma 1. 

Proposition 1 Let q > 2 and c > 0. 

given by \13\) and let Z^> be standard normal random variable. 



2q 

Then it holds 



log ce 



^ip(izW|>^)-EXi^ (1) i>^ 



n>l 



n>l 



ii. Let be a Hermite random variable of order q > 2 and H > 1 — ^ . Then 



1 



log ce 



n>l 



> cen 



l-g(l-H) 



n>l 



Proof: Let us start with the point i. Assume H < 1 — We can write 
£ ip (|Z«| > c^) - E ^ > «Vn) 

n>l n>l 

£±[> > ceV^) ~ P (Z {1) > ce^)] + E -P < -ceV^) - ^ (z (1) < ~ceV^ 



< 



n>l 



* 1 

2 E- 



n>l 



n>l 



sup 



P [ Zi l) > x ) - P ( > x 



It follows from [TO], Theorem 4.1 that 



/ l 



sup 



P(4 1 )>x)-P(z( 1 )> 



<c< 



n 



and this implies that 



E^sl p ( z » ,>i )- p ( z ' ,,> 

n>l 



(16) 



< c ^ 



V n H - 2 H G \- %z±) 

Z^n>l n ' fc L2' 2q-2> 

V n1 B ~1~\ H (= f 2g ~ 3 1 L 



and the last sums are finite (for the last one we use H < 1 — ^). The conclusion follows. 



(17) 
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Concerning the point ii. (the case H > 1 — by using a result in Proposition 3.1 
of [2] we have 



sup P (Z® >x S )-P (Z® >*)| <c(e |zP - Z^Q 2 " < cn~^- H (18) 



and as a consequence 

> cen 1 -* 1 -*)) "E^ P (l z(2) l > cen 1 -^ 1 -^) < c J^tTST 1 * 

n>l n>l n>l 

and the above series is convergent because H > 1 — ■ 
We state now the Spitzer's theorem for the variations of the fractional Brownian 

motion. 

Theorem 2 Let /i,/2 fre gu>en by p4\ ), IT5\) and the constants ci ;q> H , C2,q,H be those from 
Theorem d 

i. IfO<H<l-± then 

e^o log(c 1H q e) 



ii. Ifl>H>l — ^ then 



lim , fo fe) = ; r 

e^\og{c^ Ha e) m ) l-q{l-H) 



-2,H,q c 

Proof: It is a consequence of Lemma [1] and Proposition [TJ ■ 

Remark 2 Concerning the case H = 1 — j-, note that the correct normalization ofV n (Qp is 
(logra)^ " Because of the appearance of the term logn our approach is not directly applicable 
to this case. 

4 Hsu-Robbins theorem for the variations of fractional Brow- 
nian motion 

In this section we prove a version of the Hsu-Robbins theorem for the variations of the 
fractional Brownian motion. Concretely, we denote here by, for every e > 

9l (e) = Y,P(\Vn\>en) (19) 
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if H < 1 - ^ and by 



92(e) = J2 P {\ V n\>™ 2 - 2q(1 - H) ) 



(20) 



n>l 



if iT > 1 — 2jj. and we estimate the behavior of the functions 5«(e) as e — > 0. Note that we 



can write 

9l (e) = {\Z$\ > %l, H ^) , 92(e) = Y,P(\Z^\ > c^ H en^^ 



n>l 



n>l 



with Z { n\ Z { n } given by (fT3|) . 

We decompose it as: for H < 1 — ^- 



ait?) = E p (J z(1) i >c r,W^ 

n>l 

+ E [ p (i^i > c ri,^) - p > <^ 



n>l 



and for H > 1 - ^- 



52(e) = E p 



eC 2,q,H a 



n>l 

+ 

n>l 



(0 



We start again by consider the situation when Z n are replaced by their limits 
Lemma 2 i. Let be a standard normal random variable. Then 

lim(ce) 2 Y, P (\ zW \ > C£ v^) = 1- 

n>l 

ii. Let Z^ be a Hermite random variable with H > 1 — TTien 



lim^e) 1 -^-^ ^p(^|z( 2 )| > cen 1 -^ 1 - 11 ^ = E|Z^|^ 



n>l 



Proof: The part i. is a consequence of the result of Heyde [5]. Indeed take X{ ~ iV(0, 1) in 
(PQ). Concerning part ii. we can write 



lim(ce) i-«(i-H) ^ $ z(2) (cen 1- ^ 1- ^) 



n>l 



lim(ce) 

e^O 



:=lim(A( e ) + B(e)) 

£^0 



/OO rod r 

^^(ces^^^^Jdx - y Pi(x)d \^ z{ 2)(c£x l - q(l - H) ) 
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with P\ (x) = [x] — x + i . Moreover 

i f 00 

A(e) = (ce) i-<7(i-«) / * z(2 )(cea; 1 ~ 9 ( 1 ~' ff ')da; 

1 Z" 00 i i 

= i- q (i- h) L *«»Mv**™-*y- 



Since $ Z ( 2) (y) < y 2 we have $ Z (2 ) (y)y 1 -«( 1 -^ -v+oo 



and therefore 



A(e) = -$ Z ( 2) (ce)(ce) 



1- 9 (1-H) 



$' (2) (y)y 1-9(1-") 



where the first terms goes to zero and the second to EjZ^ 2 ^ 1 9(1 H) . The proof that the 
term B{e) converges to zero is similar to the proof of Lemma [21 point ii. ■ 

Remark 3 The Hermite random variable has moments of all orders (in particular the mo- 
ment of order jzi^nzzm ex ^ s ) s^nce it is the value at time 1 of a self similar process with 
stationary increments. 



Proposition 2 i. Let H < 1 — ^- and let Zn^ be given by (1S\) . Let also be a standard 
normal random variable. Then 

(ce) 2 £ [ p (l4 1} l > - P (\Z {1) \ > ce^) 



n>l 



ii. Let H > 1 — ^ and let Zn^ be given by [T3\) . Let Z^ be a Hermite random variable. 
Then 



{c£) t=^=h) £ [P (|4 2) | > cen 1 -^ 1 -^) - P (\Z®\ > cen 1 -^ 1 ^ 



n>l 



0. 



Remark 4 Note that the bounds [To]) . (Iff)) does not help here because the series that appear 
after their use are not convergent. 

Proof of Proposition [2} Case H < 1 — We have, for some [3 > to be chosen later, 



s 2 J2[p(\zM\>ceVt)-P(\zW\>ce 



n>l 



e 2 [P > ceVn) - P > ce^i 



n=l 



+e 2 Y, [p(\Z^\>ce^)-P(\Z m \>ce^i 

n>[e-0] 

h{e) + Jx{e). 
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Consider first the situation when H £ (0, i]. Let us choose a real number 3 such that 
2 < 3 < 4. By using ([16]), 



Ii(e) < ce 2 ^ < ce 2 e" 

n=l 



since 8 < A. Next, by using the bound for the tail probabilities of multiple integrals and 

2 



since E 



7 (i) 



converges to 1 as n —* oo 



J-^e) = e 2 p LzW > cey^J < ce~ 2 ^ exp 

n>[e-/ 3 ] ' n>[e-' 3 ] 



-C£y/n 



E 



2, 



(i) 



i 

2\ 2 



< e 2 exp 

n>[e-3] 



-cn Vfi 



and since converges to zero for 3 > 2. The same argument shows that e 2 X^n>[e-< 3 ] ^ (Z'^ > c£\fn) 
converges to zero. 

The case when H £ (|, ^j-rf) can be obtained by taking 2 < /3 < (it is possible 



since H < 1) while in the case H £ (§|r§> 1 — ^7) we have to choose 2 < /3 < 
is possible because H < 1 — 5-!). 



2?' 



qH-q+i 



(which 



Case if > 1 — i . We have, with some suitable /3 > 



e ra^J £ [ P (| Z (2)| > ^l-gtl-ff) j _ p ^| Z (2)| > C£n l- 9 (l-^) 



n>l 
-/3l 



e i3^y J- [p (\Z®\ > cen 1 -^-^) - P (\Z®\ > cen 1 ^ 1 -^ 



n=l 



H) 



+£ T=^w- ) ^ [P (\ZP\ > cen l ^ l ' H ^) - P (\Z^\ > cen 1 -^ 
■ = h(s) + J 2 {e). 

Choose -, — -| — < 8 < — — - — — - — rr (again, this is always possible when H > 1 — ^-!). 

1— q(t — n) (1 — q(l — H))(2— H— v 2(J ' 

Then 

J 2 (e) < ce 1 -9( ll -«)e (_/3)(2_H ^^ ) -+ e _ 
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and by © 



Me) <c ^2 ex P 

n>[e-P] 



I 7 \f\ 



E 



7 (2) 



l 

2\ 2 



/ J 



<c exp [cnTlfn^-^y ^ e ^oO 

n>[6-P] 



We state the main result of this section which is a consequence of Lemma [2] and 
Proposition [2j 

Theorem 3 Let q > 2 and let Ci q> H,C2 q ji be the constants from Theorem^ Let be 
a standard normal random variable, a Hermite random variable of order q > 2 and let 
9i:92 be given by [19}) and IW\) . Then 



i. IfO<H <l-±, we have (c^ H e) 2 gi (e) - e ^ 1 = EZ«. 

it. Ifl-±<H<lwe have (c 2 ^ H e) i-</U-«) g 2 {e) -> £ ^ E\Z& \ i-iv-h) . 

Remark 5 In the case H = ^ we retrieve the result {TP of |5j/. The case q = 1 is trivial, 
because in this case, since V n = B n and EV^ = n 2H , we obtain the following (by applying 
LemmaUl and\M with q = 1) 

^-^P(\V n \>sn 2H ) -^1 
log £ ^ n x ' H 

to n>l 

and 

e*Y, P {\Vn\>en™) ^v\z^f . 

n>l 

Remark 6 Let {eiji^i be a sequence of i.i.d. centered random variable with finite variance 
and let (aj)j>i a square summable real sequence. Define X n = ^2 i>1 ai£ n -i- Then the se- 
quence Sn = Xm=l [K(X n ) — EK(J n )] satisfies a central limit theorem or a non-central 
limit theorem according to the properties of the measurable function K (see J6^ or \14^ )- We 
think that our tools can be applied to investigate the tail probabilities of the sequence SV in 
the spirit of J2|/ or fWjj at least the in particular cases (for example, when Ei represents the 
increment Wi + \ — Wi of a Wiener process because in this case £{ can be written as a multiple 
integral of order one and X n can be decomposed into a sum of multiple integrals. We thank 
the referee for mentioning the references and \1J$ - 
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